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@ interactive image display. 

© A method of interactively controlling the display 
of an irnage 6n ! a monitor screerY (10), the image 
;! being stored in the form of digital data "defining the 
colour content of pixels of the image. The method 
comprises: 1 n: "' t: ' ! '' - v : • 

'M) displaying a representation of the image on 
the monitor screen (10); : ! 

ii) selecting a first point (12 ) on the image 
and a first point (12'Von the monitor screen at which 
the first image point is to be located; 

: iii) selecting with a* cursor a second point (14) 
on the image; ; ' v ' : - : 

iv> "moving the cursor relative to the monitor 
screen;- " -•,,.:"(■ ■ .-. - (I , ■ 

_ : v) and "during the cursor movement repeatedly 
^ adjusting the representation" of the image displayed 
in accordance With" one' or "more predetermined al- 
gorithms ?i so that the second image point remains 
^coincident' with "the cursor position while the first 
^ image point is fixed at the first screen point. 
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The invention relates to methods and appara- 
tus for interactively controlling the display of an 
image on a monitor screen. 

Current image modification systems, such as 
our Studio 800 system, allow an operator to view 
an image on a monitor screen, the original image 
being stored in digital form. The operator is then 
able to modify ' the shape of - the image and its 
orientation by sending appropriate, commands to a 
controlling computer. The effect of -these modifica- 
tions is then displayed on the monitor screen. In 
the past,- : in order to achieve : image.' modifications^' 
such as lateral movement across the; screen; of the 
entire image; rotation of the image, *or enlargement, 
contraction or perspective distortion of the image it 
has been necessary for. the operator to enter the 
rotation angle or scale factor either numerically or 
by manipulating an. analogue, control ;* (sometimes 
simulated using a digitising tablet), after which ; the 
computer calculates the 'effect on -the image.: and 
displays the resultant image form. 

An alternative method used in the past is" to 
define two points on the image, after which the 
computer calculates the appropriate enlargement 
factor so that the portion of the image between 
these points exactly fills a predefined rectangular 
shape. 

The disadvantages of these methods are : firstly 
that there is a significant time between the operator 
indicating the type of change he requires and the 
computer displaying the final form of the image; 
and secondly it is difficult to make small adjust- 
ments to the transformation to achieve the desired 
^result,' since only one parameter: (rotation, enlarge-: 
.merit/ shear, perspective) is changed at a time. 
Also the operation of a numerical or analogue cbn^ 
trol does not always directly correspond to the 
modification required. 

In accordance with one aspect of the present 
invention, a methocl of interactively controlling the 
display of an image, on a monitor screen, the image 
being stored in the form of digital data defining the 
colour content of pixels of the image comprises 

i) displaying a representation of the image 
on the monitor screen; 

ii) selecting a first point on the image and a 
first point on the monitor screen at which the first 
image point is to be located; 

iii) selecting with a cursor a second point on 
the image; 

iv) moving the cursor relative to the monitor 
screen; 



- '■- i t'-. r v) arid : during -the cursor movement repeat- 
edly adjusting the representation of the image dis- 
played in accordance with one or more predeter- 
mined algorithms so that the second image point 
5 remains coincident with the cursor position while 
the first image point ' is fixed at the first screen 
point. 

In a simple , operation, .the first . screen and 
io image points may already be coincident so that the 
movement of a second image point, to a new 
screen point will result in r a ; simple . rotation or 
rotation and enlargement/contraction of the image. 
Thus, in this case, the algorithm, ; applied to. the 
75 remaining pixels of the image will be ; a conven- 
tional rotation algorithm possibly combined with an 
enlargement or contraction algorithm. 

The method may further comprise selecting 
with the cursor a third point on the image and 
20 moving the cursor relative to the monitor screen, 
and during the cursor movement repeatedly adjust- 
ing the representation of the image displayed in 
accordance with "-one or more predetermined al- 
gorithms so that the third image point remains 
25 coincident with the ; '"bur^or -'position' 'white' 'the first 
and second image points are fixed relatively to the 
•.screen..,,,;,;-,.;,.,-, V( . tv r ., Ati: . nt ..^;» ri; -., A 
. Thus; after, two image points have, been;. cor- 
- rectly positioned, : the choice of - a third image., point 
30 -. and subsequent cursor movement : will result in an 
adjustment of the remainder of the image about the 
two .points,-, which J . are , now ; fixed. . Such an adjust- 
ment might comprise an . .enlargement or contrac- 
JV£; tion- or shjear^of the. Image. ? - ; ,,, rt ,, j!rr;t . 
35 !, uThis - process., can ; be. continued., with further 
points although .in general L when a predetermined 
. , number ; of,- image,, points, ^ have, be^eri ..selected, the 
selection of a further pair of image .and monitor 
. screen points -will .cause the .deselection of the 
40 oldest pair of image and monitor screen points. 

:.v,c(P some pases, step (ii) willcgmprise selecting 
. the i iifirst; image. - pqirrt^wjj^.-fte.-.cursor, .moving the 
- cursor vrejatiye .to^.the. monitor^creen, and,,duririg 
. the ; cursor r ..mpvement continuously ^.adjusting the 
45 representation.;; of ; the . image . displayed ,Jn accor- 
dance- with one or more, predetermined algorithms 
so that the first image point remains coincident with 
the cursor position. This corresponds to a simple 
displacement of the image, 
so Typically, in order to achieve interactive dis- 

play, the image will be displayed at a relatively low 
resolution. For example, if the monitor screen can 
display a highest resolution of n x m pixels, then 
the initial display may be at a resolution of n/4 x 
m/4 pixels. This process is described in more 
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detail in EP-A-0256816. 

In accordance with a second aspect of the 
present invention, apparatus for interactively con- 
trolling the display of an image on a monitor screen 
by carrying out a method in accordance with the 
first aspect of the invention, the image being stored 
in the form of digital data defining the colour con- 
tent of pixels of the image comprises a monitor 
having a monitor screen; a first store for storing the 
digital data defining the image; processing means; 
operator actuable control means to enable an oper- 
ator to move a cursor relative to an image dis- 
played on the monitor screen 6y the processing 
means; and a second store for storing a digital 
representation of the image to be displayed on the 
monitor screen, the processing means being re- 
sponsive to signals from the operator actuable con- 
trol means to cause a modified form of the image 
to be stored in the second store, the modified form 
of the image being generated by applying' one or 
more of the predetermined algorithms to data from 
the first store. 

Typically, the operator actuable control means 
will comprise a digitising table and a manual ele- 
ment for moving across the table to cause~ a cursor 
symbol to move in a corresponding manner on the 
monitor screen. Alternatively, the operator actuable 
control means could comprise a light pen or similar 
instrument for moving directly across the monitor 
screen itself. 

The processing means will typically comprise a 
computer. j 

An example of a method and apparatus for 
interactively controlling the display of an image on 
a monitor screen in accordance with the present 
invention will now be described with reference to 
the accompanying drawings, in which:- 

Figure 1 is a block diagram of the apparatus; 

and, 

Figures 2A-2G illustrate different monitor 
screen displays; and, 

Figure 3 is a flow diagram illustrating opera- 
tion of the apparatus. 

The apparatus shown in Figure 1 comprises a 
disc store 1 which holds sets of digital data defin- 
ing a number of images at a relatively high" resolu- 
tion, in a conventional manner. Thus, for each pixel 
of a coloured image, there will be four sets of 
digital data defining the intensity of each colour 
component, typically cyan, magenta, yellow, and 
black. The digital data defining a selected image 
can be loaded from the djsc store 1 into a smaller 
image store 2 under the control of a microcom- 
puter 3. An operator controls operation of the 
microcomjputer 3 via an indicator assembly 4 such 
as a digitising table 5 and cursor member 6. 

The microcomputer 3 then controls the form of 



the image in the image store 2 to be displayed on 
a monitor 7 by suitably controlling address coun- 
ters in a transform generator 8 with data defining 
certain transform algorithms. A simple algorithm 
s could be rotation of the image through a certain 
angle with the resultant rotated form of the image 
being stored in a transform store 9 defining a two 
dimensional array corresponding directly on' a one 
to one basis with pixels in the monitor screen 1 0 of 

w the monitor 7. In addition, if the original image in 
the store 2 is defined in terms of four printing 
colour components (as previously mentioned) then 
the transform generator 8 will also convert the 
information to monitor cblour components, typically 

75 red, green, and blue. 

In operation, the operator initially requests the 
microcomputer 3 to display an unmodified form 1 2 
of the image in the image store 2 on the monitor 
screen 10 (step 30, Figure 3). This is shown in 

20 Figure 2A. The operator then moves the cursor 
member 6 relative to the digitising table'5 to cause 
a cursor mark 11 on the screen to move relative to 
the displayed image 12. The operator positions the 
cursor mark 1 1 at a particular position within the 

25 : Image 12 and this location 12' (first image point) is 
communicated arid stored by the microcomputer 3 
(step 31)^ The operator then moves the cursor 11 
to a different part of the monitor screen 10. During 
this movement the position 12 (screen point) of 

30 the cursor relative to the screen is "repeatedly com- 
municated to the microcomputer 3 (step 32).- The 
microcomputer 3 then continuously responds to 
each new cursor position by determining the type 
of image transformation required to" adjust the re- 

35 presentation of the image relative* to the monitor 
' ! screen 10 so as to bring the initially defined image 
point 12 into coincidence with the current cursor 
position 12" (step 33). In this initial case, the trans- 
formation will be a simple displacement or lateral 

^ movement The displayed image 12 will thus be 
: scrolled downwardly as shown in Figure 2B as the 
cursor is moved. This achieved by the microcom- 
puter 3 determining "which pixels of the original 
image should be displayed with the current cursor 

45 position (step 34) and causing the transform gener- 
ator to address that pixel data which is downloaded 
into the correct locations in the transform store 9 
(step 35). 

The microcomputer then repeats steps 32 to 
so 35 until the operator indicates' that the nriiage point 
12 is to be fixed at the current point 12 (step 36). 
At this stage, these fixed positions are stored by 
the microcomputer 3 (step 37). Y 

With the first image and screen points fixed as 
55 indicated by reference numeral 13 in Figure 2C, 
the operator selects using the cursor a second 
image point 1 4 (step 38). The cursor is then moved 
relative to the screen and the microcomputer 3 
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responds to the current cursor position 15 (Fig 2D) 
by calculating the transformation which must be 
made to the remainder of the image to allow the 
second image point to be brought into coincidence 
with the cursor position while the initial points re- 
main fixed at the location 13 (steps 32-33). This 
transformation of the image could take one of a 
number . of forms depending on the algorithms 
which the microcomputer 3 is allowed to apply. For 
example, if a rotation . algorithm is provided while 
differential enlargement, is not allowed, then the 
microcomputer 3 will. cause the image 12 to. rotate 
about the point 13. This is indicated in Figure 2D. 
Alternatively, if rotation is not allowed but differen- 
tial , enlargement is allowed, this will result in a 
contraction of the image 12 in the vertical direction 
and; an enlargement of the image : in the horizontal 
direction as shown in. Figure 2E. , : . 

During movement of the cursor, the,, trans- 
formed images are displayed as previously de- 
scribed (steps 34-35) until the .next fjxed screen 
position is indicated and stored (steps 36-37). 

Assuming that the image, now displayed has 
the form shown in Figure 2D, there vrill now be two 
fixed pairs of image and monitor, screen points 13, 

. 16. The selection of a third point in the image (step 
38) and further movement of the cursor will result 
in the,- application by the microcomputer 3 of a 
shear algorithm, in .combination;, with the rotation 
algorithm and the . lateral movement algorithm to 
generate a further series ..of, pixel, addresses in the 

, store 2 which the transform . generator 8 accesses 
to produce -the display,shown in Figure 2F. 

; Finally, the . selection , of a. fourth image point 

.and subsequent movement of the cursor will result 
in the . application of the- previous three algorithms 
in combination , with a perspective , distortion algo- 
rithm in, which the first, second, and third.Jmage 

. points. .13, 16, 17 remain fixed relative .to .the moni- 
tor screen 10. . ■ 

After each image/screen point pair is fixed, the 
total number of such pairs is., compared with a 
threshold (step 39). eg. 4. VVhen the threshold is 
exceeded the : oldest screen/image point, pair is 
deselected (step 40) prior to selection of the next 
image point. 

: Once the final desired form of the image has 
been achieved, the microcomputer 3 may update 
the information in the image store 2 to ; define the 
image in. the final form. ... 

The transformation algorithms have a conven- 
tional form and comprise one or more simultaneous 
equations which need to be solved, the number of 
equations . depending on the number of fixed 
image/screen point pairs. For example, when four 
image points (x nt y n ) are to be transformed into 
points (xt n , yt n ), the transformation equations state 
that 



xt n = (a.x n + b.y n + c) ' (g.x n + h.y n + 1 ) 
yt n = (d.x n + e.y n + 0 > (9* n + h.y n + 1) 

5 for n = 1, 2, 3, 4: This gives 8 simultaneous 
equations of the form: 

a.x n + b.y n + c - g.x n .xt n - h.y n .xt n - xt n = 0 

d. x n + e.y n + f - g : x n .yt n - h.y n .yt „ - yt n = 0 

70 

which can 1 be solved for a, b, c, d, e, f, g, h, in the 
usual way. 

If fewer , than 4 pairs of points are defined, 
some other constraints must be imposed to unique- 
75 ly define the transformation. Suitable constraints 
are as follows: 

One point: Translation only 
Constraints: b = ,d.= g=,h = 0 
a e =. 1 \ \ 

20 Solution: c = xti - xj 

f = yti - xi ........ . 

Two points: i) Rotation and uniform scaling (and 
translation) " . ; 

Constraints: g = h = 0 ' . " 
25 b = -d . _ '. ■ .'. \. 

e. = a ' ' '/ \" [.' 

Solution: : ',, a = [(xa-xi )(xt 2 -xti ) ., + t (y2-yi)(yt2- 

yti)M(xz-xi) a + (y 2 -yi) 2 l ' \ .'/'. 

: d = , t(x2-??i )(yt 2 -yti ) - Jyz-yi )(xt2-xti jj/Kx?-* ) 2 + 
30 (ya-yi) 2 ] ' , . 

. c ,= xti - ajc.i ,+ d.yi ( = xt2-a.x 2 + d.y 2 ) , ; ' 

f K y* 1 " *d^i-a.yi'( = yta^-X2-a : y2) 

Two points: . lf ii) . NonTuniform' stretch (and 

translation)^,. . ' ^ ... ~, . v , '\ J^... tt _ 

35 Constraints: b =" d == g = h. = 0 . 

Solution: .a =..(xt2-tii)f(x2-xi). 

e = (yt2-ytij/(y 2 -yi) 
. .c v = xtt - a-xi + d.yi (=xta - a.x 2 + d.y 2 ) = 

(x 2 .xti - Xi.Xt 2 )/(X 2 -Xi) . i . ? 

40 . f - yti - d-xi -,a.yi ; ( = yt2 1 - d.x 2 .- a.y 2 ) = (y 2 .yti - 
yi .yt 2 )/(y 2 : yi ) . . 

Three points: General affine transformation 
Constraints: . ,g = h = Q.. 

..Solution: . . ' By solving the. six simultaneous 
45 : equations given. by n = 1, 2, 3: 
a.x n . +. : b.y n '+ c - xt„. = 0 
d.x n + e.y n + f-ytn = 0 

so Claims 

1. A method of interactively controlling the dis- 
play of an image on a monitor screen, the image 
being stored in the form. of digital data defining the 
55 colour content of pixels of .the. image, the method 
comprising 

i) displaying a representation of the image 
on the monitor screen (10); 
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ii) selecting a first point (12') on the image 
and a first point (12") on the monitor screen at 
which the first image point is to be (ocated; 

iii) selecting with a cursor a second point 
(14) on the image; 

iy) moving the cursor relative to the monitor 
screen; 

v) and during the cursor movement repeat- 
edly* adiusting the representation of the image dis- 
played in accordance with one or more predeter- 
mined algorithms so that the second image point 
remains coincident with the cursor position while 
the first image point is fixed at the first screen 
point. 

2. A method according to claim 1 , further com- 
prising selecting with the cursor a third point (15) 
on the image and moving the cursor relative to the 
monitor screen (10), and during, the cursor move- 
ment repeatedly adjusting the /representation of the 
image displayed in accordance with one or more 
predetermined; algorithms so that the third image 
point remains coincident with the, cursor position 
while the first and second image points are fixed 
relatively to the screen. 

3. A method according to claim^ or claim 2, 
wherein when a predetermined number of image 
points have been selected, the . selection of a fur- 
ther pair of image and monitor screen points will 
cause the deselection of the oldest pair of image 
and monitor screen points. ' '*":' ' - : ' 

. 4:-A method according to any of the preceding 
claims, wherein step 7 * (ii) comprises selecting the 
first image point with the cursor- moving the cursor 
relative to the monitor screen, and during the cur- 
sor movement continuously adjusting j the repre- 
sentation of the image displayed in accordance 
with one or more predetermined algorithms so that 
the first image point remains coincident with the 
cursor position. . 

5. Apparatus for interactively controlling, the 
display of an image on a monitor screen by "carry- 
ing out a . method in accordance with any of the 

* preceding ~ claims, the image being stored Jn the 
form of digital data defining the colour content of 

-pixels of the image,, the apparatus comprising a 
monitor (7) having a monitor screen (10); a first 
store (2) for. storing the digital data defining the 
image; processing means (3, 8); operator actuable 
control means (4) to enable an operator to move a 
cursor relative to an image displayed on the moni- 
tor screen "(10) by. the processing" means; and a 
second store (9) for storing a digital representation 
of the image to be displayed on the monitor 
screen, the processing means (3,8)* being respon- 
sive to signals from the operator, actuable control 
means to cause a modified form of the image to be 
stored in the second store (9), the modified form of 



the image being generated by applying one or 
more of the predetermined algorithms to data from 
the first store (2). 

6. Apparatus according to claim 5, wherein the 
5 processing means (3,8) comprises a suitably pro- 
grammed computer^ 
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